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The  Fokker-Planck  equation  corresponding  to  the  first-order  phase-locked  loop  in  the  presence  of 
exponentially  correlated  noise  is  studied.  For  the  case  of  zero  signal-to-noise  ratio  and  zero  initial 
detuning  an  analytical  solution  is  obtained  for  the  Fokker-Planck  equation,  reduced  modulo  2ff.  The 
solution  is  the  transition  probability  density  function  (p.d.f.)  and  gives  explicit  relationships  between 
loop  parameters  and  the  transient  behavior  of  the  phase  error  process.  From  the  transition  p.d.f. 
the  transition  cumulative  distribution  function  and  the  time-dependent  variance  of  phase  error  are 
easily  obtained.  At  sufficiently  small  values  of  Dt,  where  D  is  the  diffusion  constant  and  t  is  the 
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ON  THE  SOLUTION  OF  A  FOKKER-PLANCK  EQUATION 
IN  THE  PRESENCE  OF  CORRELATED  NOISE 


INTRODUCTION 

Tracking  devices  employing  the  phased-loeking  principle  are  widely  used  in  modern  communica¬ 
tions,  radar  tracking,  navigation,  guidance,  and  control.  Such  devices  include  the  phase-locked  loops 
(PLLs)  [1],  Costas  loops  (2),  data-aided  loops  [3],  hybrid  loops  14],  and  symbol  synchronizers  (5], 
which  are  essentially  digital  PLLs.  The  stochastic  differential  equations  that  describe  the  operations  of 
these  loops  [1-5]  are  well  known,  and  Lindsey  [6]  shows  that  these  equations  have  similar  forms.  Thus 
a  study  of  the  PLL  system  can  provide  new  information  concerning  this  important  device  as  well  as 
reveal  operational  characteristics  of  the  other  tracking  loops  [2-5]. 

In  the  design  and  analysis  of  PLLs  two  loop  characteristics  are  of  major  concern:  acquisition  of  a 
signal’s  phase  and  the  loss  of  lock.  Both  of  these  characteristics  depend  on  the  time-dependent  or  tran¬ 
sition  probability  density  function  (p.d.f.)  of  loop  phase  error.  Under  certain  suitable  assumptions  of 
noise  conditions  the  transition  p.d.f.  of  a  PLL  is  described  by  a  Fokker-Planck  equation,  and  much 
attention  has  been  directed  to  the  solution  of  this  equation.  Previous  transient  analysis  of  PLLs  have 
been  mainly  concerned  with  first-order  PLLs  in  the  presence  of  white  Gaussian  noise  (WGN).  Dom- 
iniak  and  Pickholtz  [7]  employed  numerical  techniques  developed  by  von  Neumann  and  Richtmyer  [8] 
to  study  the  Fokker-Planck  equation  in  the  presence  of  WGN.  La  Frieda  and  Lindsey  [9]  used  eigen¬ 
function  expansions  and  numerically  evaluated  the  eigenvalues  for  the  transition  p.d.f.,  with  the  phase 
error  reduced  modulo  2ir.  Ohlson  and  Rutherford  [10]  used  numerical  integration  to  evaluate  the  tran¬ 
sient  behavior,  without  the  modulo-27r  condition  Recently  El-Masry  [11]  used  a  Fourier  series  with 
lime- varying  coefficients  to  represent  the  p.d.f.  with  the  phase  error  reduced  modulo  2tt 

These  previous  studies  17-11]  provide  essentially  a  complete  understanding  of  the  first-order  PLL 
in  the  presence  of  WGN.  However,  nothing  has  been  known  about  the  transient  behavior  of  the  first- 
order  PLLs  in  the  presence  of  correlated  noise.  The  assumption  of  correlated  noise  in  PLL  systems  is 
probably  more  realistic  than  the  WGN  assumption  when  the  phase  detector  is  preceded  by  bandpass 
filters. 

In  this  report  the  first-order  PLL  in  the  presence  of  exponentially  correlated  noise  will  be  studied. 
First  the  Fokker-Planck  equation  will  be  presented  together  with  the  corresponding  initial  and  boundary 
conditions.  Unfortunately  this  Fokker-Planck  equation  cannot  be  solved.  However,  for  the  case  of  a 
zero  signal-to-noise  ratio  an  analytical  solution  can  be  found  and  will  be  presented.  It  will  be  shown 
that  the  solution  is  a  convergent  series  which  satisfies  the  initial  and  boundary  conditions  and  is 
differentiable  with  respect  to  phase  error  <t>  and  time  i.  Because  the  solution  obtained  is  the  transition 
p.d.f.  of  the  modulo-2»r  phase-error  process,  other  loop  statistics  such  as  the  cumulative  distribution 
function  and  variance  of  phase  error  can  be  easily  derived.  Another  advantage  of  the  analytical-solution 
approach  of  this  report  is  that  the  effect  of  noise  bandwidth  on  the  transient  phase-error  process  «M/) 
can  be  shown  explicitly. 
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FOKKER-PLANCK  EQUATION 


Lei  0(f)  be  the  phase  error  of  a  first-order  PLL  (Fig.  1).  Assume  a  sinusoidal  input  and  a  corre¬ 
lated  noise  process  *(/).  The  phase  error  0(/)  satisfies  the  nonlinear  stochastic  differential  equations 


d<t>U) 

dt 

dxit) 

dt 


(l0  ~  AK  sin  0(f)  —  Kxit) 
-/3 xit)  +  finil) 


|0|  <  it,  |x|  <  oo,  0  <  r  <  oo, 


(1) 


where  ft0  -  <o  -  u>0  is  the  initial  detuning,  A  is  the  received  signal  amplitude,  K  is  the  loop  gain, 
sin  <Mf)  is  the  input  nonlinearity,  x(t)  is  the  exponentially  correlated  process  (also  called  colored 
noise),  /3  is  a  constant,  and  nit)  is  assumed  to  be  a  WGN  process  with  a  zero  mean  and  a  two-sided 
spectral  density  of  NJ7  W/Hz.  Because  nit)  is  a  WGN  process,  the  solution  to  (1)  has  vector  Markov 
properties,  and  the  transition  p.d.f.  satisfies  the  forward  Fokker-Planck  equation  [12]: 

If  “  -§£  I(ft° "  AK  sin  *  "  Kx)p]  +  (px)  +  ^20' 

0  <  f  <  oo,  |0|  <  tt,  Ul  ^  00,  (2) 

where  p  —  pi<f>.  x,  t  |  0o.  fo )  is  the  modulo-2»r  transition  p.d.f.  of  0  and  Jr.  The  initial  and  bound¬ 
ary  conditions  are  governed  by  the  physics  of  our  problem.  We  assume  that  the  PLL  is  in  lock  at  initial 
lime  f0.  Thus  the  initial  condition  is 

e-x*n*} 

lim  p(0,  x,  t  I  0O,  jr0.  /0)  -  8(0  -  0n)  —===-,  (3) 

'-'0  yj lira  $ 

where  8( . . . )  is  the  Dirac  della  function.  In  (3),  jc(/0)  is  assumed  to  be  normal  with  a  zero  mean  and 
variance  <r,2  and  to  be  independent  of  jr it)  to  ensure  that  x(t)  is  stationary  (13).  The  boundary  condi¬ 
tions,  which  are  determined  from  the  modulo-2ir  assumptions,  are 

pi-tr.  x,  1 )  »  pin,  x,  t )  and  ~^(—w,  x,  t)  —  x,  t)  (4a) 

OX  ox 


and 


p(0,  — 00 ,  /)  “  p(0,  00 ,  f)  ”  ~^(0,  —00,  t )  “ 

Ojr  Bar 


(0,  00,  f)  —  0. 


In  addition  the  transition  p.d.f.  satisfies  the  normalization  condition 

Jf  p(0.  x,  1  |  0o,  xn,  tQ)  dxd<t>  —  I,  for  all  f. 

-O®  nf  f 


(4b) 

(5) 


xti) 


Fig.  I  —  Model  of  a  firsl-order  phase-locked  loop 
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Let  us  consider  (2)  with  zero  initial  detuning  (Ho  —  0)  with  the  substitutions 

N(fi2  n AK  L  K  A  L 

D  —  — : — ,  t  -  D  t.  e  -  -rrr,  k ■  -  — ,  and  k2  -  -^7. 


D' 


D' 


Equation  (2)  can  now  be  written  as 


ff-epcos*  +  sin*|f  +  M  ff  +  *i/>  +  *2*  §f  +  0. 


(6) 


(7) 


Unfortunately  neither  analytic  nor  numerical  solutions  of  (7)  are  available.  For  the  case  of  a  zero 
signal-to-noise  ratio  (t  —  0)  and  zero  initial  detuning  (fl0  -  0)  it  will  be  shown  that  an  analytical  solu¬ 
tion  can  be  obtained  for  the  reduced  equation 


d£ 

dr 


+  *1  +  *2*  £  + 


d2 

dx 2 


P  =  Lp. 


(8) 


SOLUTION  OF  THE  REDUCED  EQUATION 


Let  us  assume  as  a  solution  of  (8)  an  expansion  of  the  form 
jr,  r)-  £  x), 


(9) 


m-0.  tl,±2,... 
41-0. 


where  the  A„„(t)  depend  only  on  r  and  the  *)  depend  on  <t>  and  x.  Because  L  in  (8)  is 

independent  of  r,  one  may  use  the  method  of  separation  of  variables.  With  Km„  as  the  separation 
parameter,  the  Am„(r)  can  be  shown  to  be  of  the  form 


Amn^)  -  c„„  e 


where  the  Cm„  are  unknown  coefficients  and  the  km„  are  eigenvalues  which  satisfy 

x)  -  x) 

with  boundary  conditions 


x)  -  ymAn.  x )  and 


8K. 


(-W,  X) 


d<(> 


(w.  jt) 


and 


ymM’  -°°>  “  ymM-  °°> 


8  Vm 


(^,  -00) 


8K„ 


L  «>)  —  0. 


(10) 

(II) 

(12a) 

(12b) 


8*  dx 

To  solve  (II),  we  note  that  the  variables  4  and  x  are  also  separable.  We  let  a„  be  the  separation 
parameter  and  write  jr)  —  Qm(4)X„„(x),  which  results  in  an  equation  in  4>  given  by 

_L  **2 
8$ 

Solving  (13)  and  requiring  that  4>m  be  normalized,  we  obtain 


♦w(-ir)  -  ♦„(»). 


(13) 


»„(♦)  -  jL  = 


The  remaining  equation  in  x  has  the  form 


8X 

dx1 


+  k2  x 


dx 


\J— T,  m  —  0,  ±1,  ±2,  ... 


+  <*2  -  \mn  ~  amk^)Xm„  -  0. 


(14) 


(15a) 
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where 


V  (-00)  -  y  (00)  -  (-00)  -  ^S2-(oo)  -  0. 


(15b) 


dx  dx 

This  equation  is  in  the  form  of  a  standard  second-order  linear  differential  equation  with  regular  boun¬ 


dary  conditions.  Making  the  changes  of  variables 

-  x„n(x)  exp[/ft  /■($)(/*], 

Fi,)  -  if. 

C  “  a  (x  +  y). 


and 


will  result  [12]  in  an  equation 


where 


and  where 


2  imk  | 

y-~iT 

+  <*.  -  ii)  »•„<{)  -  0. 
o{ 


I'm  M^)-  lim  — — - 0. 

l{l-~  l£l-*« 


I 

2*2 


2*2  -  4X™  - 


4m2*  12 

~*T 


Equation  (18)  is  a  standard  form.  Its  solution  can  be  written  as 

*«.<«•>  ~  N.  e~ii/2  HMJ. 

where  is  the  Hermite  polynomial  of  nth  order  with  the  argument 

2ik\m  I 


Vr("  + 


k 1 


(16a) 

(16b) 

(17a) 

(17b) 

(17c) 

(18) 

(19a) 

(19b) 

(20) 

(21) 


Because  (20)  is  a  bounded  solution  of  (18),  the  requirement  on  X„  can  be  found  to  be  k„  —  2/t  +  1 
n  —  0. 1.2 . Thus  (19b)  can  be  simplified  to  yield 

[*,W 


*  mm  ™  * 


*2 


m2  -  n*2- 


(22) 


Expressing  the  solution  of  (20)  in  terms  of  Xmn{x)  by  noting  the  changes  of  variables  of  (16)  and  (17), 
wc  obtain 


Xmmlx)  -  Nm  c~hxi'*  HAx). 


(23) 


Wc  now  require  the  functions  Xm„(x)  to  be  orthonormal.  Then  the  scalar  product  ( .  Xkl)  is 

<Xm„.  Xkl)  -  XmAx)Xkl(x)wix)  dx  -  6^8^.  (24) 
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where  w( x)  -  ekl*  2  is  a  weighting  function,  Xk/  denotes  the  complex  conjugate  of  Xkh  and 
Bmk  and  are  Kronecker  delta  functions  (5W  -  I  if  p  —  q,  and  h  —  0  if  p  ^  q).  By  use  of  an  iden¬ 
tity  for  the  weighted  orthogonality  of  the  Hermite  polynomials  1 141 


e  x*  H.(x)HAx)  dx 


0,  if  m  i*  n, 

2nnlir,  if  m  -  «, 


the  coefficient  N.  in  (23)  can  be  determined  as 


N„ 


t 

Vvf2'"' 


To  compute  the  unknown  coefficients  C„„  from  (10),  we  write  the  solution  as 

x,  r)  -  £  £  Cm 


ex”"TrmM.  x). 


(25) 


(26) 


(27) 


Thus,  by  setting  r  —  0  in  (27)  and  using  the  orthonormal  properties  of  jr),  we  can  determine 

Cmm  from 


cm „  -  /  f_"  p(<f>.  X,  0)  y„M<  x)w(x)  dxd<f> 


«  N”  |  2ik'm 
•Jlirkjar  |  A/2<rJ/tj 

Substituting  C„„  into  (27)  and  integrating  over  x  from  -<»  to  oo,  we  get 


1  1  °° 

p(<6,  /)  -  -r —  +  —  T  cos  m<b  e 
2  ir  w 


(28) 


(29) 


m— 1 


This  is  the  desired  analytical  solution.  It  is  the  transition  p.d.f.  of  the  first-order  PLL  in  the  presence  of 
exponentially  correlated  noise  with  zero  signal  input  and  zero  initial  detuning.  This  solution  is  a  con¬ 
vergent  series  and  clearly  satisfies  the  modulo- 2rr  boundary  conditions  (4).  To  see  that  it  satisfies  the 
initial  condition  of  the  PLL  in  lock,  let  t0  —  0,  </>{t0)  -  0.  Then,  without  loss  of  generality, 


lim  p(0,  t)  —  ~ —  +  —  V  cos m<f>  -  8(<£). 
,-o  2v  n 


(30) 


We  would  expect  the  solution  of  (29)  to  approach  the  solution  for  the  case  of  WGN  input  as 
/3  —  oo,  because  jt (/),  the  exponentially  correlated  process  given  in  (1),  will  approach  a  WGN  process 
when  j3  — »  oo.  To  show  this,  we  see  that  x(t)  is  a  normal  process  with  zero  mean  and  variance  <rf  (and 
thus  is  a  result  from  a  linear  operation  on  a  WGN  process  with  zero  mean  and  variance  <r2).  The  auto¬ 
correlation  function  of  jc(/)  can  be  shown  (131  to  be 

*„('  (3D 

From  the  theory  of  delta  functions,  R„(i  -  can  be  shown  to  be  a  della  function  in  the  limit  as 
f3  —  oo  by  treating  it  as  a  symbolic  function  (15J.  However,  for  practical  purposes  /?„(r  -  r0)  is  a  delta 
function  in  the  limit  if  we  can  show 

lim  4  -  oo  (32) 

l/~t0  l—o. 

and 

lim  f  4-  e~^r*  dr  «■  I,  r  —  t  —  t0.  (33) 

fl—vm  **  2 
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Because  R„(t  -  /0)  satisfies  (32)  and  (33),  we  conclude 

lim  Rxx(i  -  to )  —  8 (/  -  Iq).  (34) 

oo  l 

Since  x(t)  is  a  Gaussian  process,  its  statistics  are  completely  specified  by  its  mean  and  autocorrelation 
function.  Returning  to  (29)  and  taking  the  limit  as/3  —  «>,  we  can  show 


1  1  ” 

lim  p(<l>.  /)-  —  +  —  £  cos  m<t>e 


a- 


lit 


m— I 


(35) 


which  is  the  solution  for  the  first-order  PLL  in  the  presence  of  WGN  when  the  input  signal  and  the  ini¬ 
tial  detuning  are  zero.  This  result  is  consistent  with  those  obtained  previously  by  La  Frieda  and 
Lindsey  (91. 


An  important  advantage  of  our  analytic  approach  to  solutions  of  the  Fokker-Planck  equation  is 
that  the  analytical  result  of  (29)  gives  the  explicit  relationship  between  /3  (the  noise  bandwidth)  and 
(the  time-dependent  phase  error  process).  To  see  the  precise  meaning  of  /3,  consider  xit)  as  the 
output  of  an  RC  filler  whose  input  is  a  WGN  process  with  zero  mean  and  two-sided  spectral  density 
NJ2  W/Hz.  Thus  the  filter  input  spectral  density  is  Sn(f )  -  No/2  W/Hz.  The  spectral  density  of  the 
RC  filter  output  will  be 


sx(f)  - 


No 

2 


1  + 

J 

/o 

(36) 


where  /0  —  1/2tt  RC  is  the  frequency  at  which  the  response  of  the  RC  filler  is  3  dB  below  its  peak. 
The  autocorrelation  function  of  x(t)  can  be  determined  from 


R„(r)  -  e~lm  $,(«)  dm 

N 


-  CU0  ^ 


(37) 


where  r  -  /  -  /„  and  m0  =  1/RC.  Relating  (37)  to  (31),  we  see  that  0  -  o>0  Thus  /3  can  be  con¬ 
sidered  as  the  — 3-dB  radian-frequency  bandwidth  of  an  RC  low-pass  filter. 


The  transition  cumulative  distribution  function  is  obtained  easily  front  p(</>.  t),  where 

prob  (|</>l  <  0,)  -  f  '  p(</>, 

_  0/  |  2  sin  w0/  ^1 

”  2tt  ir  ",  m  e 


(38) 


The  time-dependent  variance  of  the  phase  error  is  often  of  interest.  This  can  be  obtained  simply  from 
var  10(f)!  -  f  02p(0,  ()d<f> 


’Ll  +  a  v  cos  wtr 

0  m- 1  m 


(39) 
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NUMERICAL  RESULTS 

Equation  (29)  was  used  to  compute  values  for  the  transition  p.d.f.s  of  the  first-order  PLL  in  the 
presence  of  exponentially  correlated  noise,  (his  equation  being  for  (he  case  of  zero  signal  input  (e  —  0) 
and  zero  initial  detuning  (Cl 0—  0).  Figure  2  shows  the  transition  p.d.f.  for  p  =  °°,  which  reduces  to 
the  solution  of  the  first-order  PLL  in  the  presence  of  W«JN,  and  these  results  agree  with  those  obtained 
by  La  Frieda  and  Lindsey  (9],  Figure  3  is  a  plot  of  the  transition  p.d.f.  when  p  =  100  In  both  Fig  2 
and  Fig.  3  the  dispersion  of  the  p.d.f.  increases  with  increased  Di  (D  being  called  the  diffusion  con¬ 
stant).  At  Dt  =  2.5  the  p  d  f  s  have  almost  reached  the  steady-state  distribution  value,  which  is  a  uni¬ 
form  distribution  between  —  it  and  n  Figure  4  shows  loop's  phase  decay  at  a  fixed  lime  ( Dt  =  0  125) 
for  different  values  of  correlated  noise  bandwidth  p  As  expected,  phase-error  dispersion  grows  with 
increased  fi 

The  transition  cumulative  distribution  function  was  also  computed,  for  p —  100  (Fig  5).  For 
small  values  of  Dt ,  the  distribution  of  <ft(t)  concentrates  about  tf>  =  0,  and  it  is  conjectured  that  the 
modulo-27r  phase-error  statistics  are  a  good  approximation  to  the  loop  loss-of-lock  statistics,  because  for 
Dt  sufficiently  small  the  phase  error  <j>(t)  has  not  had  a  chance  to  skip  cycles  and  thus  no  buildup  of 
phase-error  probabilities  has  occurred  at  <f>  -  ±2kir ,  k  —  1.  2,  3 . 

The  time-dependent  variance  of  the  phase  error  was  computed  (Fig  6).  Figure  6  shows  that  a 
higher  phase-error  variance  is  associated  with  a  larger  noise  bandwidth  p.  as  expected 


SUMMARY  AND  DISCUSSION 

We  have  shown  a  method  for  obtaining  an  analytical  solution  to  the  Fokker-Planck  equation 
corresponding  to  the  first-order  phase-locked  loop  (PLL)  in  the  presence  of  exponentially  correlated 
noise  for  the  case  of  zero  signal-to-noisc  ratio,  zero  initial  detuning,  and  phase  error  process  reduced 
modulo  2ir  The  solution  is  the  transition  probability  density  function  (p.d.f  )  of  phase  error  and  is 
represented  by  a  convergent  series  showing  the  explicit  dependence  on  the  noise  bandwidth  fi  and  the 
diffusion  constant  D 

Computed  values  of  transition  p.d  f.s,  transition  cumulative  distribution  functions,  and  the  time- 
dependent  variance  of  the  phase  error  are  shown  in  Figs  2  through  6.  These  computed  values  indicate 
the  following: 

•  For  Dt  >  2.5  the  transition  p.d.f.  essentially  reaches  the  steady-state  value,  which  is  a  uniform 
distribution  between  —ir  and  w 

•  At  Dt  =  0.25,  with  p  >  100,  the  transition  p.d.f.  for  the  exponentially  correlated  noise  can  be 
approximated  by  the  p.d.f  for  the  Gaussian  noise  case  (represented  by  p  ^  10')  We  now  have  a 
means  for  assessing  the  validity  of  using  the  Gaussian  noise  approximation  for  the  RC  band-limited 
noise  in  the  PLL  system 
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Fig.  2  —  Transition  probability  density  functions  for  the  first- 
order  PLL  in  the  presence  of  exponentially  correlated  noise 
with  c  —  0.  0  -  oo,  and  fl0  -  0 


Fig.  3  —  Transition  p.d.f.s  for  the  first-order  PLL  in  the  pres¬ 
ence  of  exponentially  correlated  noise  with  e  —  0,  p  —  100, 
and  n0-  0 


Fig  4  —  Transition  p.d.f.s  for  the  first-order  PLL  in  the  pres¬ 
ence  of  exponentially  correlated  noise  for  various  values  of  (} 
with  *  —  0,  Dr  -  0.25,  and  fi0  —  0 


Fig.  5  —  Transition  cumulative  distribution  func¬ 
tions  for  the  first-order  PLL  in  the  presence  of  ex¬ 
ponentially  correlated  noise  with  *  -  0,  0  -  100. 
and  fln  -  0 
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